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Abstract 

For an nxn random image with independent pixels, black with probability p(n) 
and white with probability 1— p(n), the probability of satisfying any given first- 
order sentence tends to or 1, provided both p{n)nk and (1 — p{n))n~k tend to 
or +oo, for any integer k. The result is proved by computing the threshold 
function for basic local sentences, and applying Gaifman's theorem. 
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1 Introduction 



The motivation for this work came for the Gestalt theory of vision (see (3j and references 
therein), a basic idea of which is that the human eye focuses first on remarkable or 
unusual features of an image, i.e. features that would have a low probability of occurring 
if the image were random. Hence the natural question: which properties of a random 
image have a low or high probability? Here we shall deal with the simplest model for 
random images: 

Definition 1.1 Let n be a positive integer. Consider the pixel set X n = {1, . . . , n} 2 . 
An image of size nxn is a mapping from X n to {0,1} (white/black). Their set is 
denoted by E n . It is endowed with the product ofn 2 independent copies of the Bernoulli 
distribution with parameter p, that will be denoted by /i„ iP : 

n 

V v eE n , ^ p ( v ) = J] P "W)(i - p) 1 -^ . 

i,j =1 

A random image of size nxn and level p, denoted by X np , is a random element of E n 
with distribution /i„. p . 

In other words, a random image of size nxn and level p is a square image in which all 
pixels are independent, each being black with probability p or white with probability 
1-p. 

We shall use the elementary definitions and concepts of first-order logic on finite 
models, such as described for instance in Ebbinghaus and Flum [4]. Gaifman's theorem 
([H] and |H p. 31) shows that first-order sentences are essentially local. They can be 
logically reduced to the appearance of fixed subimages (precise definitions will be given 
in section |2j). Assume p is fixed. Then as n tends to infinity, any given subimage of 
fixed size should appear somewhere in the random image X n p , with probability tending 
to 1: this is the two dimensional version of the well known "typing monkey" paradox. 
It justifies intuitively that the zero-one law should hold for fixed values of p. Our main 
result is more general. 

Theorem 1.2 Let p{n) be a function from N into [0,1] such that: 

2 2 

Vfc = 1, 2, . . . , lim n*p(n) = or + oo and lim n * (1 — p(n)) = or + oo . 

n^oo n—roo 

Let A be a first-order sentence. Then: 

lim Prob[ J n „ (= A] = or 1 . 

Zero-one laws have a long history (cf. Compton [2] for a review and chapter 3 of [4J). 
The first of them was proved independently by Glebskii et al. [H| and Fagin It 
applied to the first-order logic on a finite universe without constraints, and uniform 
probability. As an example, interpret the elements of E n as directed graphs with vertex 
set {1, . . . , n}, by putting an edge between i and j if pixel is black. Then Z n , p 
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becomes a random directed graph (or digraph) with edge probability p (see for instance 
[TTJ [12], or [I] f° r a general reference). As a particular case of the Glebskii et al. - 
Fagin theorem, the zero-one law holds for first-order propositions on random digraphs. 
However, first-order logic on images is more expressive than on digraphs, since the 
geometry of images is not conserved in the graph interpretation. 

The theory of random (undirected) graphs was inaugurated by Erdos and Renyi [H] 
(see [UEB] f° r general references). The zero-one law holds for random graphs with edge 
probability p, as a consequence of Oberschelp's theorem [TH] on parametric classes (see 
(H p. 74 or [H] p. 318). At first, zero-one laws were essentially combinatorial, as they 
applied to the uniform probability on the set of all structures, corresponding to edge 
probability p = | in the case of graphs. It was soon noticed that they also hold for any 
fixed value of p. But it is well known that random graphs become more interesting by 
letting p = p{n) tend to as n tends to infinity. A crucial notion for random graphs 
is the appearance of given subgraphs ([IB] p. 309). The threshold function for the 
appearance of a given subgraph in a random graph is p(n) = n~~ , where v and e are 
integers. For p{n) = n~~ , the probability of appearance for certain subgraphs does not 
tend to or 1. Using the extension technique, (pHIB] and [3] p. 73), Shelah and Spencer 
[T5] made a complete study of those functions p(n) for which the zero-one law holds for 
random graphs, and proved in particular that it does for p(n) = n~ a , for any irrational 
a. Theorem 11.21 is the analogue for random images of Shelah and Spencer's result. 
To understand why, first notice that the random image model is invariant through 
exchanging black and white, together with p and 1— p. Thus we will consider only 
functions p{n) tending to 0. We shall define precisely the notion of threshold function 
in sectional and prove that all threshold functions for patterns are of type p{n) = 'nr~a: 
the zero-one law does not hold for these values. For instance, \i p[n) is small (resp.: 
large) compared to n~ 2 , the probability of having at least one black pixel tends to 
(resp.: 1). But for p{n) = n~ 2 , it tends to 1 — e _1 . Theorem 11.21 essentially says that 
the zero-one law holds for any function p(n) which is not a threshold function. 

It is worth pointing out here that theorem 11.21 can be extended easily to other 
random structures, along two different directions. Firstly, we chose to restrict the 
study to binary images, using a single unary relation in the language (cf. section |2j). 
With slight modifications of the proofs, and the values of threshold functions, one could 
introduce a finite set of "color" unary relations, allowing for the coding of multilevel 
gray or color images. The other possible generalisation concerns the type of graphs. 
An image is essentially a colored square lattice. The crucial property of that graph for 
our proof is that there exists a fixed number of vertices at fixed distance of any vertex 
(ball have bounded cardinality). Our study can easily be extended to any family of 
graphs with bounded balls. For instance, theorem [O] also holds for a randomly colored 
d-dimensional square lattice with n d points, up to replacing by rT~k in its statement. 

SectionElis devoted to first-order logic on images. There we shall discuss basic local 
sentences ( definition 12.21 and [4] p. 31), and reduce them to combinations of "pattern 
sentences" ( definition ^ .3jl . showing that a zero-one law holds for all first-order sentences 
if it holds for basic local or pattern sentences fproposition l2.4|) . This will trivially imply 
that theorem 11.21 holds for fixed values of p. The section will end with two examples 
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of (second-order) sentences whose probability under fi n i tends to ~. 

In section we shall define the notion of threshold function (definition 13 .2|) and 

2 

prove that all threshold functions for basic local sentences are of type n"fc (proposition 
IH.4JI . Theorem 11.21 easily follows from propositions 12.41 and 13.41 

2 First-order logic for images 

We shall follow the notations and definitions in chapter of |4j for the syntax and 
semantics of first-order logic. The vocabulary is the set of relations (or predicates). 
They apply to the universe (or domain). In our case the universe will be the pixel set 
X n . Image properties will not only be statements on colors of pixels but also about 
their geometrical arrangement. Our vocabulary will consist of 1 unary and 4 binary 
relations. The unary relation C is interpreted as the color: Cx means that x is a black 
pixel and ->Cx that it is white. Before defining the binary relations, we need a few 
considerations on the geometry of X n . 

The pixel set X n is embedded in Z 2 , and naturally endowed with a graph struc- 
ture. In image analysis (see for instance chapter 6 of Serra [Hj), the cases most often 
considered are: 

• the 4- connectivity. For i,j > 0, the neighbors of are: 

• the 8 -connectivity. The 4 diagonal neighbors are also included: 

(z + 1, j + 1), (i + 1), (z + 1), (z -l,j-±). 

At this point a few words about the borders are needed. In order to avoid particular 
cases (pixels having less than 4 or 8 neighbors), we shall impose a periodic boundary, 
deciding for instance that (l,j) is neighbor with (n,j), (n,j — 1), and (n,j + 1), so that 
the graph becomes a regular 2-dimensional torus. Although it may seem somewhat 
unnatural for images, without that assumption the zero-one law would fail. Consider 
indeed the (first-order) sentence "there exist 4 black pixels each having only one hor- 
izontal neighbor". Without periodic boundary conditions, it applies to the 4 corners, 
and the probability for a random image T np to satisfy it is p 4 . From now on, the 
identification n + 1 = 1 holds for all operations on pixels. 

Once the graph structure is fixed, the relative positions of pixels can be described 
by binary predicates. In the case of 4-connectivity 2 binary predicates suffice, U (up) 
and R (right): Uxy means that y — x + (0, 1) and Rxy that y — x + (1,0). In the 
case of 8-connectivity, two more predicates must be added, Di and D 2 : Dixy means 
that y = x + (1, 1) and D 2 xy that y — x + (1, —1). For convenience reasons, we shall 
stick to 8-connectivity. Thus the vocabulary of images is the set {C, U, R, D±, D 2 }. 
Once the universe and the vocabulary are fixed, the structures are particular models 
of the relations, applied to variables in the domain. To any structure, a graph is 
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naturally associated (|3j p. 26), connecting those pairs of elements {x,y} which are 
such that Sxy or Syx are satisfied, where S is any of the binary relations. Of course 
only those structures for which the associated graph is the square lattice with diagonals 
and periodic boundaries will be called images. As usual, the graph distance d is defined 
as the minimal length of a path between two pixels. We shall denote by B(x, r) the 
ball of center x and radius r: 



In the case of 8-connectivity, B(x,r) is a square containing (2r + l) 2 pixels. 

Formulas such as Cx, Uxy, Rxy. . . are called atoms. The first-order logic ([4] p. 5) is 
the set of all formulas obtained by recursively combining first-order formulas, starting 
with atoms. 

Definition 2.1 The set C\ of first- order formulas is defined by: 

1. All atoms belong to L\. 

2. If A and B are first- order formulas, then (->A) } (WxAx) and (A A B) also belong 



Here are two examples of first-order formulas: 

1. Vx, y, (Rxy A Uyz) — > D\xz, 

2. (3y (Rxy A Uyz)) <-> D x xz 

Notice that any image satisfies them both: adding the two diagonal relations D 1 and 
D 2 does not make the language any more expressive. The only reason why the 8- 
connectivity was preferred here is that the corresponding balls are squares. 

We are interested in formulas for which it can be decided if they are true or false 
for any given image, i.e. for which all variables are quantified. They are called closed 
formulas, or sentences. Such a sentence A defines a subset A n of E n : that of all images 
7] that satisfy A (r/ \= A). Its probability for /i n>J) will still be denoted by fj, ntP (A). 



Gaifman's theorem (|H p. 31), states that every first-order sentence is equivalent to a 
boolean combination of basic local sentences. 

Definition 2.2 A basic local sentence has the form: 



B(x, r) = { y e X n ; d(x, y) < r } 



to C\. 




n\=A 




(2.1) 



where: 
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• m and r are fixed nonnegative integers, 

• for all i = 1, . . . ,m, ipi(x) 6 L\ is a formula for which only variable x is free (not 
bound by a quantifier), and the other variables all belong to the ball B(x,r). 

For any x and a fixed radius r, consider now a complete description D(x) of the ball 
B(x, r), i.e. a first-order sentence for which all statements concerning pixels at distance 
at most r of x are either asserted or negated. There exists a single image Id of size 
(2r+ l)x(2r + 1), centered at x, satisfying it. Thus D(x,r) can be interpreted as: "the 
pattern of pixels at distance at most r of x is Id"- 

Definition 2.3 A pattern sentence has the form: 




where: 

• m and r are fixed nonnegative integers, 

• for all i = 1, . . . ,m, -Dj(x) is a complete description of the ball B(x, r). 
Examples of (interpreted) pattern sentences are: 

1. "there exist 3 black pixels", 

2. "there exists a 3x3 white square", 

3. "there exist 3 non overlapping 5x5 white squares with a black pixel on the center". 
Figure d gives another illustration. Obviously, pattern sentences are particular cases 





Figure 1: Illustration of a pattern sentence, for m = 4 and r = 1. 

of basic local sentences. Proposition 12.41 below reduces the proof of zero-one laws for 
random images to pattern sentences. 
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Proposition 2.4 Consider the following three assertions, 
(i) The probability of any pattern sentence tends to or 1. 

(ii) The probability of any basic local sentence tends to or 1. 

(Hi) The probability of any first order sentence tends to or 1. 
Then (i) implies (ii) and (ii) implies (Hi). 

Proof. Observe first that if the probabilities of sentences A and B tend to or 1, then 
so do the probabilities of ->A and A A B. This follows from elementary properties of 
probabilities. As a consequence, if the probability of A tends to or 1 for any A in 
a given family, this remains true for any finite boolean combination of sentences in 
that family. Thus Gaifman's theorem yields that (ii) implies (Hi). We shall prove now 
that every basic local sentence is either unsatisfiable or a finite boolean combination 
of pattern sentences. Indeed, consider a formula ip(x) for which only variable x is free, 
and the other variables all belong to the ball B(x,r). Either it is not satisfiable, or 
there exists a finite set of (2r + l)x (2r + 1) images (at most 2^ 2r+1 ^ ) which satisfy it. 
To each of these images corresponds a complete description D(x) which implies ip(x). 
So ip(x) is equivalent to the disjunction of these -D(x)'s: 

i/j(x) ^ \J D(x) . (2.3) 

In formula (|2.1j) . one can replace each ipi{x.i) by a disjunction of complete descrip- 
tions. Rearranging terms, one sees that the basic local sentence (I2.1j) is itself a finite 
disjunction of pattern sentences. □ 

The zero-one law for fixed values of p is an easy consequence of proposition l2.4l Indeed, 
for fixed p, the probability of any pattern sentence tends to 1. To see why, consider 
the following sentence: 

3x ( /\ A(*+((i-l)(2r+l),0))] , (2.4) 

\l<i<m / 

interpreted as: "subimages Jd i; . . . , Ijj m appear in m consecutive, horizontally adjacent 
balls of radius r". It clearly implies (|2.2j) . But 1)2.4)) is equivalent to the appearance 
of a given subimage on a rectangle of size (2r + 1) x (m(2r + 1)). This occurs in a 
random image Z„ )P with probability tending to 1 as n tends to infinity. Thus ()2.2j) has 
a probability tending to one of being satisfied by 1 n ,p- 

This section ends with two counter-examples of (second-order) sentences the prob- 
ability of which does not tend to or 1. The first one is "the number of black pixels is 
even". Its probability is |(1 + (1— 2p) n ), which tends to \ for any p such that < p < 1. 
The second example is more visual. Define a 6-connected path as an m-tuple of pixels 
(xi, . . . , x m ), such that for i = 1, . . . ,m — 1, x i+ i G x,- t ± {(1, 0), (0, 1), (1, 1)}, and the 
borders of the image are not crossed (see an illustration on figure |2l). Consider now the 
two sentences: 
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1. BLR: "there exists a 6-connected path of black pixels from left to right", 

2. WTB: "there exists a 6-connected path of white pixels from top to bottom". 

Some geometrical considerations show that an image satisfies BLR if and only if it does 
not satisfy WTB (this would not hold for 4- or 8-connected paths: see [14] p. 183). 
Take now p = |. Symmetry implies that n n i(BLR) = ^ n x{WTB). Hence both 

probabilities must be equal to |. 

The sentences BLR and WTB are examples of those properties studied by perco- 
lation theory (see Grimmett |l()j for a general reference). Actually the random image 
model that we consider here is a finite approximation of site percolation ([101 p. 24). 
Using percolation techniques, one can prove that fj, n>p (BLR) tends to if p < |, to 1 
if p > \. 




Figure 2: A 6-connected path of black pixels from left to right. 



3 Threshold functions for basic local sentences 

The notions studied in this section have exact counterparts in the theory of random 
graphs as presented by Spencer [TH]. We begin with the asymptotic probability of single 
pattern sentences, which correspond to the appearance of subgraphs ([16] p. 309). 

Proposition 3.1 Let r and k be two integers such that < k < (2r + l) 2 . Let I be a 

fixed (2r + 1) x (2r + 1) image, with k black pixels and h = (2r + l) 2 — k white pixels. 
Let D(x) be the complete description of the ball B(x,r) satisfied only by a copy of I , 
centered at x. Let D be the sentence (3x D(x)). Let p = p(n) be a function from N to 
[0,1]. 

// lim n 2 p(n) k = then lim n n , p ( n )(D) = . (3.1) 
// lim n 2 p(n) k (l - p{n)) h = +oo then lim ^ p{n) (D) = 1 . (3.2) 
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// lim n 2 (l -p{n)) h = then lim ^ p{n) {D) = . (3.3) 



Proof: We already noticed the symmetry of the problem: switching black and white 
together with p and l—p should leave statements unchanged. In particular the proofs 
of (|3.1j) and (|3.3j) are symmetric, and only the former will be given. 

For a given x, the probability of occurence of / in the ball B(x, r) is : 

ti n , P (n){D{x)) =p(n)\l-p(n)) h . 
The pattern sentence D is the disjunction of all D(x)'s: 

\J D(x) . 

x£X n 

Hence: 

Vn, P (n){D) < n 2 p(n) k (l-p(n)) h , 

from which (|3.1j) follows. 

Consider now the following set of pixels: 

T n = { (r + 1 + a{2r + 1), r + 1 + (3{2r + 1)) , a, = 0, . . . , -1 } , (3.4) 

where |_-J denotes the integer part. Call r(n) the cardinality of T{n): 



r(n) 



n 



2r + 1 

which is of order n 2 . Notice that the disjunction of D(x)'s for x G T n implies D. 

V D(x) - D . 



x€T n 



The distance between any two distinct pixels x,y G T n is larger than 2r, and the balls 
B(x,r) and B(y,r) do not overlap. Therefore the events "X niP |= D(x) v for x G T n are 
mutually independent. Thus: 



\xeT n 

= l-(l-p(n) k (l-p(n)) h y (n) 
> 1 - exp(-r(n)p(n) k (l - p(n)) h ) , 

hence El. □ 



Due to the symmetry of the model, we shall consider from now on that p{n) < |. 
Proposition 13.11 shows that the appearance of a given subimage only depends on its 



9 



2 

number of black pixels: if p(n) is small compared to n", then no subimage of fixed 
size, with k black pixels, should appear in T{n,p(n)). If p(n) is large compared to n~k , 
all subimages with k black pixels should appear. Proposition Kill does not cover the 
particular cases k = (appearance of a white square) and k = (2r + l) 2 (black square). 
They are easy to deal with. Denote by W (resp.: B) the pattern sentence (3x D(x)), 
where D(x) denotes the complete description of B(x,r) being all white (resp.: all 
black). Then n n , P {n)(W) always tends to 1 (remember that p{n) < \). Statements 
(l3~TTl and apply to B, with k = (2r + l) 2 . 

The notion of threshold function is a formalisation of the behaviors that have just 
been described. 

Definition 3.2 Let A be a sentence. A threshold function for A is a function r(n) 
such that: 

r>(n) 

lim — — — = implies lim p, n p r n ) (A) = , 

n— +oo r(n) n^oo ' 

and : 

lim — — - = +oo implies lim u nv r n \(A) = 1 . 

ra— >oo r[n) " n— >oo 

Notice that a threshold function is not unique. For instance if r(n) is a threshold 
function for A, then so is cr{n) for any positive constant c. It is costumary to ignore 
this and talk about "the" threshold function of A. For instance, the threshold function 
for "there exists a black pixel" is n~ 2 . 

Proposition 13. II essentially says that the threshold function for the appearance of a 
given subimage / is n", where k is the number of black pixels in I. Proposition 13.41 

2 

below will show that the threshold function for a basic local sentence L is n fc < L > , where 
k(L) is an integer that we call the index of L. Its definition uses the decomposition 
(I2.3jl of a local property into a finite disjunction of complete descriptions, already used 
in the proof of proposition 12.41 

Definition 3.3 Let L be the basic local sentence defined by: 

3x 1 ...3x m y\ d(xi,Xj) > 2r J A /\ ipifa 

\l<i<j<m / \l<i<m 

If L is not satisfiable, then we shall set k(L) = +oo. If L is satisfiable, for each 
i = 1, . . . , m, consider the finite set {-Dj,i, . . . , D^ ^} of those complete descriptions on 
the ball B(xt, r) which imply ipi^Xi). 

ipi(xi) <-> y D Lj (xi) . 
i<j<ck 

Each complete description D ii j(xi) corresponds to an image on B(xi,r). Denote by kij 
its number of black pixels. 

The index of L, denoted by k(L) is defined by: 

k(L) = maxmin/cj,- . (3-5) 
i=i j=i 
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The intuition behind definition 13.31 is the following. Assume p(n) is small compared to 

2 

n fc(L) . Then there exists i such that none of the D it j(xi) can be satisfied, therefore 
there is no x« such that ipi(xi) is satisfied, and L is not satisfied. On the contrary, if 

_ 2 

p(n) is large compared to n fc ( L > , then for alH = 1, . . . ,m, if)i(xi) should be satisfied 
for at least one pixel x i7 and the probability of satisfying L should be large. In other 

2 

words, n k( ~ L ) is the threshold function of L. 

Proposition 3.4 Let L be a basic local property, and k(L) be its index. If L is satis- 

2 

fiable and k{L) > 0, then its threshold function is n k ^ . If k{L) = 0, its probability 
tends to 1 (for p(n) < \). 

Proof. Assume L is satisfiable (otherwise its probability is null) and k(L) > 0. Let 

2 _ 

r(n) = n fc < L ) . For p(n) < we need to prove that /i n , P (n) tends to \{p{n)/r(n) tends 
to 0, and that it tends to 1 if p(n)/r(n) tends to +oo. The former will be proved first. 
Consider again the decomposition of L into complete descriptions: 



L <-> 3xi . . . 3x r , 



/\ d(x i ,x J )>2r) A I f\ \J DijfaU 
vl<»<j<m / \l<i<m l<j<di / 



If p(n)/r(n) tends to 0, there exists i such that: 

Vj = 1, . . . , di , lim n 2 p(n) kl - j = . 

n— >oo 

By proposition 13.11 the probability of (3x D it j(x)) tends to zero for all j = 1, . . . 
Therefore the probability of (3x^(x)) tends to 0, which implies that fi n<P (n)(L) tends 
to 0. 

Conversely, for each i = 1, . . . , m, choose one of the Dij(x) 7 s, such that the number 
of black pixels in the corresponding image is minimal (among all fcjj's). Denote that 
particular description by Di(x). Consider now the following pattern sentence, which 
implies L: 

3xi... 3x m ( /\ d(x h x j )>2r\ A ( f\ D^xM . (3.6) 

Vl<i<j<m / \l<i<m / 

As in the proof of proposition 13.11 we shall use the lattice T n , defined by (|3.4jl . Re- 
member that its cardinality r(n) is of order n 2 . The pattern sentence (13. 6 j) is implied 
by: 



3x 1 ...Bx m ( /\ Xi eT n \ A ( /\ ar^arj] A [ /\ A(^) j . (3.7) 

\l<i<m / \l<i<jr<m / \l<i<m J 



Assume first that k(L) = 0. Then necessarily, for each i, the image corresponding to 
Di(x) has only white pixels. With p(n) < |, the probability of observing a (2r + 1) x 
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(2r + 1) white image is larger than n = 2 ( 2r+1 ) 2 . Since subimages centered at the 
points of T n are independent, the probability of ()3.7|) is larger than: 



which tends to 1 as n tends to infinity. 

Assume now that k(L) > 0. The images corresponding to the minimal descriptions 
Di need not be all different: renumber different descriptions Di as D[, . . . ,D' m ,. Let 
k(i) be the number of black pixels of D[ (hence k(L) = max{k(i)}). Let 7r.j(n) be the 
probability of D[(x), for a given x: 



>From the random image X n p define the random variable Ni as the number of those 
pixels Xi G T n such that X njP is described by D'^Xi) on the ball B(xi,r). Since the 
different balls do not overlap, iV, has a binomial distribution, with parameters r(n) 
and TCi(n). Assuming p{n)/r{n) tends to +oo, it is easy to check that the product 
r{n)^i{n) also tends to infinity. Therefore the probability that N is larger than m 
tends to 1, and so does the probability that all the N^s are larger than m. But if all 
the iVj's are larger than m, then X n p satisfies (I3.7jl . hence and L. □ 

Having characterized the threshold functions of all basic local properties, the proof 
of theorem 11.21 is now clear. If p(n)n~k tends to or +oo for any positive integer k, 
then by proposition 13.41 the probability of any basic local sentence tends to or 1. 
This remains true for any boolean combination of basic local sentences (cf. proposition 
I2.4jl . By Gaifman's theorem, these boolean combinations cover all first-order sentences. 
Hence the zero-one law for first-order logic. 
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